MIPos: Mobile Image Positioning on Mixed Reality Web Applications ased on Mobile Sensors

In this paper we propose a position aware, user controlled and real time enabled visual approach to arrange real world images within virtual scenes by leveraging modern web APIs to get access to location, mobile sensors and camera. Enhancing a virtual scene with images of its real substitute to create Mixed Reality scenes involves the accurate positioning of real world images within their corresponding location in the virtual scene. To achieve that in 3D web applications, which are able to run on mobile devices, the approach needs to overcome web and mobile specific limitations. Instead of relying on heavy image processing in JavaScript we describe the detection of movement and orientation of a user’s device by leveraging sensor fusion and filters to compensate sensor noise along with a pattern based step detection scheme. We reflect the acquired data to the device camera stream within a corresponding web 3D scene. This allows the instant capturing of precisely positioned real world images within the virtual scene. In addition, our approach achieves an indoor positioning system along with the possibility to directly embed user media within Mixed and Augmented Reality scenes by using pure web APIs and avoiding the extensive use of computational resources through feature detection algorithms. CR Categories: I.3.1 [Computer Graphics]: Three-Dimensional Graphics and Realism—Input devices I.3.6 [Computer Graphics]: Three-Dimensional Graphics and Realism—Interaction techniques